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Abstract 



We prove that a Hamilton-Jacobi equation in ID with periodic forcing has a set of generalized solutions such 
that each solution is a sum of linear and continuous periodic functions; we also give a condition of uniqueness 
^\ ' of such solution in terms of Aubry-Mather theory. 



> ■ 1 Introduction 
in 

en 

o 

O: -^+Ho(^^]+Uit,.)^0, (1) 



Consider a Hamilton-Jacobi equation 



dS „ /dS 



where x S M and the functions Ho{p), p G M, and U{t, x) satisfy the following assumptions: 



(Hi) Hq{p) is of class C^ and its derivative Hq{p) is strictly growing: Hq{p2) > Hq{pi) iff p2 > Pi, and locally 
Lipschitzian: for any P > there exists C > such that for allpi, p2 S [— -P, P] \Hl){pi) — Hq{p2)\ < C|pi— p2|- 

o, 

C^ , {H2) For any iV > there exists P > such that if p e M, \p\ > P, then Ho{p) > N\p\. 

J^ ■ 1 

O ■ (^3) U{t,x) is of class C and its derivative dU/dx is Lipschitzian. 



{H4) U{t, x) is periodic with respect to t and x: U{t + 1,2:) = U{t, a: + 1) = U{t, x) for all {t, x) G 



p2 



Here and below, (') denotes an ordinary derivative and 'periodic' means 'periodic with period 1 in each variable'; 
C^ I we shall refer to the whole set of {Hi)-{H/i) as assumptions {H). 

Suppose C/(i, x) = 0; then equation p) has a one-parameter family of classical solutions S'"(f, x) = ax — Ho(a)t. 
In this paper we prove the following 

Theorem I If Ho(j)) and U{t,x) satisfy assumptions [H), then for any a G M there exists a continuous periodic 
function s°'{t,x) such that the function 

S°'{t,x)^ax-H{a)t + s''{t,x) (2) 

is a viscosity solution of equation (yj (for definition of a viscosity solution to a Hamilton-Jacobi equation, see ^). 
Here H{a) is a convex function satisfying 

min U(t,x) < H(a)- Ho(a) < max U(t,x). (3) 

In section 2 we introduce an explicit representation of a viscosity solution to Cauchy problem for equation ffl) by 
the well-known Lax-Olemik formula. In the sequel, this formula is used as a substitute for the general definition 
of a viscosity solution. 

*See also: Mat. Sbomik 190:10 (1999) 87-104 (in Russian). English translation: Sbornik: Mathematics, 190:10 (1999) 1487-1504. 



Let Oo e M and S'^°(t,x) be some viscosity solution to (|^) of the form (||) with a = Uq. For any c £ K, 
S°'° {t,x) + c is another viscosity solution to (|l|) of the form (g) . The following statement specifies the case when the 
converse is true, i.e., when any viscosity solution of the form (Q) with a = ao differs from S'^°{t,x) by a constant: 

Theorem II Let s°'{t,x) be the continuous periodic function of theorem I and Lu{a) be the corresponding rotation 
number (see section 6). If uj{a) is irrational, then s°'{t,x) is unique up to an additive constant. 

This paper is organized as follows. In sections 2 and 3 we prove some auxiliary results. Section 4 is devoted 
to the proof of theorem I. In sections 5 and 6 we introduce a many- valued map associated with a solution (0) and 
study the connection between properties of such solutions and Aubry-Mather theory [|l| || ^ . Section 7 concludes 
the proof of theorem II. 

The results of this paper were announced in pT[ ; they extend and strengthen some results of W . 

Similar results were obtained by Weinan E |^ independently of this author. 

The author is grateful to Prof. Ya.G. Sinai for setting of the problem and constant attention to this work and 
to Prof. Weinan E for the opportunity to read a preprint of his paper. 

2 The value function of the action functional 

A Legendre transform of the function Hq{p) is a C^ function £o(w) such that Lq(Hq{p)) — p. If Hq(j)) satisfies 
assumptions (i?i) and {H2), then Lq{v) is finite for all w G M, has a continuous strictly growing derivative, and 
satisfies the condition obtained from {H2) by substitution of Lq for Hq. The Lagrangian associated with equation (|l|) 
is a function L{t, a;, v) of the form 

L{t, X, v) ^ Lo{v) - U{t, x). (4) 

Let a;, y, s, t S M, s < t. The set of all absolutely continuous functions ^: [s,i] — > K such that ^(s) = y, ^{t) — x, 
and i(-,C(-))C'(")) is Lebesgue integrable is called the set of admissible trajectories (or trajectories for short) and 
is denoted by 0(s, y; i, x). The functional defined on ^{s, y; t, x) by the formula 

C{s,y-t,xm^ f L{T,^{r),eiT))dr= f [Lol^'M) - C/(T,C(r))] dr (5) 

J s J s 

is called the action functional associated with the Lagrangian L(t, x, v). It follows from assumptions (H) that this 
functional is bounded from below on the set f2(s, y; t, x). The infimum of C{s, y; t, x) over ^{s, y; t, x) is called the 
value function of the action functional and is denoted by L(s, y; i, x). 

Lemma 1 (see [^, sections 2.6, 9.2, and 9.3]) Suppose Hq{p) and U{t,x) satisfy assumptions (H); then there 
exists a trajectory ^q G ^{s, y; t, x) such that C{s, y; t, x)[^o] — L{s, y; t, x), ^0 "is of class C^ in [s, t], and there exists 
a C^ function A; [s,t] -^ M such that 

A(r)=4(^^(r)), A'(r) = -^^^i^^M, ,<,<,. (6) 

For all R, s, t gM. such that R > 0, s < t and all x, y G M such that \x — y\ < R{t — s) there exists a positive constant 
Ci = Ci{R, s, t) such that \£,q(t)\ < Ci, s < t <t for any ^0 G ^{s, y; t, x) such that C{s, y; t, x)[^q] — L{s, y; i, x). 

The trajectory ^0 is called a minimizer of the functional C{s, y; t, x). 

Let a G M and sq(x) be a continuous periodic function. The viscosity solution of a Cauchy problem for 
equation p) with the initial data 

5*0 (x) = ax + so(x) (7) 

is given by the Lax-Oleinik formula (see, e.g., [^ section 11.1]) 

Sit,x) = m{{So{y) + LiO,y;t,x)). (8) 

j/GE 

Lemma 2 The function L(s, y; t, x) is diagonally periodic: 

L{s, y + l;t,x + 1) = L{s + 1, y; i + 1, x) = i(s, y; t, x). (9) 



This lemma follows from periodicity of U{t, x) in t and x. 

Corollary Let S{t, x) be the solution of the Cauchy problem for equation m) with the initial data ([T); then 
S{t, x) — ax + s{t, x), where s{t, x) is periodic in x. 

Proof. 

s{t, x + 1) = S{t, a; + 1) - a(a; + 1) = 

= inf {soiy) + a{y - {x + 1)) + L(0, y;t,x+ 1)) = 

= inf {so{y - 1) + a{{y - 1) - x)) + L(0, y - 1; i, x)) = 

J/6K 

= S(t^ x) — ax — s{t, x). 



n 



Lemma 3 For all r,s,t, x,y&R, s<r<t, 



L{s, y; t, x) = min {L{s, y; r, z) + L{r, z; i, x)). (10) 



This is a variant of the well-known Bellman's principle of optimality. 

Lemma 4 The function L{s,y]t,x) is everywhere finite and satisfies inequalities 



M < -^L{s, y; t, x) - L^ (^^ ] < -m, (11) 

t — s \ t — s 



where m = mmi^t.x)eR'' U{t,x), M = max(t^j,)gR2 U{t,x). 

Proof. Consider the fmictional 

Cis,y;t,xm^ f Lo(e'(r))dT. 



Recall that Lo{v) is a C^ convex function with strictly icreasing derivative. Then it can be shown in the usual way 
that the trajectory ^(r) — x{t — s)/{t — s) + y{t — T)/{t — s), s < r < t, is a minimizer of this functional in the set 
Q.{s,y; t,x) and 



C{s,y;t,x)[S,] = (t- s)Lo 



t- s 



Let ^0 be a minimizer of the functional C{s,y;t,x) in the class D,(s,y;t,x), i.e., C{s,y;t,x)[^o] = L{s,y;t,x). 

We have 

/ X — V \ ^ ^ 

L{s,y]t,x) - {t- s)Lo ( -^3^ j ^ ^s,y;t,x)[^o] ~ C{s,y;t,x)[^]) = 

t 
U{T,^^{T))dT + {Z{s,y;t,x)[^Q] - Z{s,y;t,x)[C\) > 



and 



> it — s) \ — max Uit, x) 

I X — 11 \ -^ -'^ 

L{s,y; t, x)~ {t- s)Lo ( j—j j ^ C{s,y;t,x) [^o] ~ -^(s, y, t, x) [£,] < 

< C{s,y;t,x)[(] - C{s,y;t,x)[^] = 

U(T,£(T))dT <(t-s)(- min U(t,x) 
~ \ it,x)eM.'^ 

Multiplying these inequalities by {t — s)^^, we obtain (O). □ 

Lemma 5 Let R, xi, X2, yi, y2, s, t gR be such that s < t, R > 0, \xi — yj\ < R{t — s), i, j — 1,2; then there 
exists C — C{s, t, R) CzM., C > 0, such that 

\L{s, yi;t, xi) ~ L{s, y2] t, X2)\ < C{\yi - y2\ + \xi ~ X2\). (12) 



In other words, L(s, y; t, x) is locally Lipschitzian. 
Proof. It is sufficient to prove the inequality 



\L{s,y;t,xi) - L{s,y;t,X2)\ < C\xi -xa], 



(13) 



where \xi — y\ < R(t — s), i = 1,2. The inequality for the first pair of arguments of the function L is proved 
similarly; combining these two inequalities, we obtain (|l2|). 

Let ^0 G ^{s, y, t, xi) be a minimizer of the functional C{s, y; t,xi). By lemma |l|, it follows that |$o(t)| < Ci = 
Ci{R,s,t), s < T < t. Consider the trajectory ^(r) = ^o{t) + {x2 — xi){t — s)/{t ~ s), s < t < t. It is clear that 
^ S Q{s,y;t,X2)- We have 

L{s,y;t,X2) - L{s,y;t,xi) < C{s,y;t,X2)[£,] - C{s,y;t,xi)[£,o] = 



t 



t — s 



dr- 



dr. 



The functions U{t, x) and Lq{v) are of class C ; in addition, it follows from (i^a) and {H4) that \dU{t, x)/dx\ < Mi 
for some positive Afi G M. Hence, 



L{s,y;t,X2) - L{s,y;t,xi) < 
\X2 -Xi 



< 



(t — s) max 
t — s T£[s,t],\e\<i 

\X2 - Xi\ {t - s)^ 



L'o U'oir) + 



.\X2 -Xi\ 



t 



+ 



-A'/i. 



t- s 2 

We recall that L'q{v) is finite for all v; thus for some C = C{s, t, R, Mi) G R, C > 0, 

L{s,y;t,X2) - L{s,y;t,xi) < C\x2 - xi\. 

Similarly, L{s,y;t,X2) — L{s,y;t,xi) > C\x2 — xi\. This completes the proof of inequality (p^). D 

We see that L{s, y; t, x) is continuous in x and y; therefore it follows from lemma that infimum is attained in 
the Lax-Olcinik formula (pi). In the sequel, we shall use max instead of inf in all formulas derived from (@). 

Proposition 6 Let xi, X2, yi, 2/2 j s, r, t ^M., s < r < t; suppose there exists zg G M such that for all z gM. 

L{s,yi;r,z) + Lir,z;t,Xi)>L{s,yi;r,ZQ) + Lir,ZQ;t,x^), i ^ 1,2. (14) 

Then either xi = X2 and yi ~ j/2 or {xi — X2){yi ~ 2/2) < 0. 

Proof. For xi = X2 and j/i = 2/2 there is nothing to prove. Assume xi ^ X2 or j/i 7^ j/2- Let C^€ ^{s,yi\T,Z(j) 
and ^f G r2(r, zq! t^ Xi) be minimizers of functionals £(s, yi] r, zq) and £(r, zq] t, Xi 
it follows that for i = 1,2 

Hence for i = 1,2 the trajectories 

e.(r) 



1,2 



• By ify 



and lemma 



L{s, yi] r, zo) + L{r, zq; t, Xi) = L{s, y^; t, Xi). 



if{T), s<T<r 
ef(T), r<T<s 



i^i G n{s,yi;t,Xi)) 



are minimizers of C{s, yi; t, Xi). Using lemma El we see that the trajectories ^i, i = 1, 2, are of class C . This means 
that m'ir-0) = (e>)'(r + 0) = eKO, * = 1,2. 

We claim that ^[{r) ^ ^2{r)- Indeed, for i — 1,2 let A^ be the C^ functions corresponding to trajectories ^^ by 
lemma U Assume that ^J(r) = S,2ir); then, by continuity of L'q{-), it follows from (0) that Ai(r) — A2(r). Consider 
the Cauchy problem for the system of ordinary differential equations (0) on the interval [s, t] with initial data 
^o('') = Ci(^) = ^2(r) and A(r) = Ai(r) = A2(r). It follows from assumption (i/3) that the function dU{t,x)/dx is 
Lipschitzian and its absolute value is bounded by the constant Mi > 0; thus it follows from the second equation (0) 
that |A(r) — A(r)| < Mi{t — s) for all t G [s,t]. Hence it follows from assumption (Hi) that the system 



^^(r) = i/^(A(r)), A'(r) 



9t/(r,eo(T) 



S <T <t. 



which is equivalent to (|g), satisfies the conditions of the uniqueness theorem. Thus ^i{t) — £,2iT), s < t < t, and 
in particular xi — xi and y\ =2/2- This contradiction proves that ^^(r) ^ ^lif)- 

Now we prove that there exists 5 > such that s<r — 5, r + (5<i, and if r G (r — (5, r + (5), then ^i(r) and 
^^ij) coincide only ai t — r. Indeed, let a sequence {i„} be such that for all n, s < tn < t, i„ ^ r, Ci(in) = £,2{tn), 
and lini„^oo tn — f- This implies that 

ri^cxo l:,j — r n— >oo t„ — T 

a contradiction. 

Now assume that (xi — X2){yi — 2/2) > 0; to be precise, let xi < X2 and j/i < 2/2- For j = 1, 2 define trajectories 
fi e VL{s,yi]t,Xi) by fi(T) = min{^i(T),^2(T)} and ^2(1") = max{^i(T),^2(T)}. By the above each of ^1 and ^2 
coincides with ^1 and ^2 on a finite number of intervals of finite length. Let us check that the trajectories ^i, 
i — 1,2, are minimizers. Indeed, we have 



1 ^; 



jC{s,yi;t,Xi)[^i] > C{s,yi;t,Xi)[Ci] = L{s,yi;t,x,), i = 1,2 

and 

C{s,yi;t,xi)[^i\ + C{s,y2;t,X2)[C2] = 
^ C{s,yi;t,xi)[^i] +C{s,y2;t,X2)[£,2] = 
== L{s, yi; t,xi)+ L{s, 2/2; t, X2). 

Theieiore C{s,yi]t,Xi)[^t] ^ L{s,yt;t,Xi), i ^ 1,2. 

By lemma |l|, the trajectories Ci, ^ — 1, 2, are of class C^. This implies that £^^{r — 0) = ^^(r + 0), i = 1,2, where 
all one-sided derivatives exist. But this means that ^[{r — 0) = ^2('' + 0) and ^2{r — 0) = Cil*^ + 0)i since r is the 
only intersection point of ^1 and ^2 in the interval (r — d,r + S). Thus ^[{r) = C2(^)- This contradiction concludes 
the proof. D 

Corollary Let xi, X2, yi, 2/27 s, i G M &e such that xi < X2, 2/1 < 2/2; o,nd s < t. Then 

L{s, 2/i; t,xi) + L{s, 2/2; t, X2) < L(s, 2/2; t, xi) + L(s, yi;t, X2)- (15) 



Proof. Let ^1 e ^{s, 2/1; t, X2) and ^2 G 5^(s, 2/2; i, 2:1) be nfinimizers of functionals C{s, 2/1; t, X2) and £(s, 2/2; i, 2:1), 
respectively. Note that £,i{s) < ^2(3) and £,i{t) > S,2{t); hence there exist r, zq, s < r < t, such that ^i(r) = £.2{r) = 
zq. Thereiove L{s,yi;r,zo) + L{r,zo;t,X2) = L{s,yi;t,X2), L{s,y2;r, zq) + L{r,zo;t,xi) = L{s,y2;t,xi) and by 
lemma | L{s, 2/1; r, zq) + L{r, z^; t, xi) > L{s, yi;t, xi), L{s, 2/2; r, zq) + L{r, z^; t, X2) > L{s, 2/2; t, X2)- This implies 
that L{s, 2/1; t, xi) + L{s, 2/2; t, X2) < L{s, 2/1; t, X2) + L{s, 2/2; t, xi). Assume that this weak inequality is actually an 
equality. This assumption means that for all z G R 

L(s, yi;t, xi) = L{s, yi;r, zq) + L{r, zq; t, xi) < L{s, yi;r, z) + L{r, z; t, xi), 
L{s, 2/2; t, X2) = L{s, 2/2; r, zo) + L{r, zq; t, X2) < L{s, 2/2; r, z) + L{r, z; t, X2)- 

It follows from the previous lemma that (xi — 2:2) (2/1 — 2/2) < 0. This contradiction concludes the proof. D 

3 Reduction to a functional equation 

Let a e K, so(a;) be a continuous periodic function. Suppose S{t,x) is the solution (@) of the Cauchy problem 
for equation (nl) with the initial function 5*0(2;) — ax + s^){x). Since the Lagrangian L(t,x,v) = Lq{v) — U{t,x) is 
periodic in t, it is natural to consider S{t, x) at integer values of t: t = n = 1, 2, . . . Using (0), we get 

S{n, x) — ax = min {so{y) + L{0, y; n, x) + a(y — x)) — Sn{x; a, sq). 

yev. 

As a function of x, s„(x;a,so) is a pointwisc minimum of a family of continuous functions, so it is continuous. 
Further, it follows from the corollary to lemma that it is periodic; thus s„(x;a,so) = miufegz Sn{x — fc;a,so)- 
Using the above formula, lemma y, and periodicity of so [y) , we get 

Sn(x; a. So) — min min (so(2/) + L{Q, y + k;n,x) + a{y + fc — x)). 



Thus for any n > and y, x eM the quantity L(0, y + k;n,x) + a{y + k — x) is bounded from below as a function 
oi k G Z. We denote 

L^(y, x) — min {L{0, y + k;n,x) + a{y + k — x)), (16) 

where minimum is attained since L(s, y; t, x) is continuous and grows superhnearly as \x ~ y\ ^> oo; hence, 

s„(x;a, So) = min(so(2/) + L^(y,a;)). (17) 



Proposition 7 For any n — 1,2, . . ., the function L'^{y, x) is periodic and Lipschitzian in x; the Lipschitz constant 
C*{a) does not depend on n and y £ M. For any ui > 0, n2 > 0, 

Ll,+n. (y, x) = mm {Ll^ {y, z) + Ll^{z, x)). (18) 

Proof. Using the definition ( [iq ) and lemma |[ we obtain L."(ty + l,x + m) = L'^{y,x) for any integer /, m; thus 
L'^{y,x) is periodic. Combining (Qq) for n = Ui + n2 with (HG) for s = 0, r = ni, and t = ni + n^ and using 
lemma 0, we get 

^ni+n2 (2/' 2;) = min (L°^ (y, z) + L(0, z; n2,x) + a{z - x)). 

Using periodicity of L°^ (y, z) in z, we obtain (|l^). 

Let us prove that L1{y,x) is Lipschitzian. Since L1{y,x) is a pointwise minimum of a family of continuous 
functions, it is continuous. Denote by TV the maximum value of L1{y,x) on the set Q = {{y,x) | < y < 1,0 < 
X < \}. Clearly, there exists i? > such that Lq{x — y — k) + a{y + k — x) > N + max(t .j.)gR2 U{t,x) for all 
(y,x) e Q whenever \k\ > R. Thus it follows from lemma ^that for any {y,x) G Q 

Li(y,x) = min (L(0,y + k;l,x) + a(y + k — x)). 
fcez,|fe|<_R 

On the other hand, using lemma pi we see that all functions L{0, y + k; l,x) + a{y + k — x), \k\ < R, are Lipschitzian 
on Q with the constant C*{a) — C{0,1,R+ 1) + \a\. Thus L1{y,x) is Lipschitzian on Q (and, by periodicity, on 
the whole R^) with the same constant. 

Now it follows from ( |l8|) that for any n>2 

Kiy, x) = min {Ll_^{y, z) + L?(z, x)), 

that is for any y e M L'^iVi x) as a function of x is a pointwise minimum of a family of functions sharing the same 
Lipschitz constant C*{a). Thus L'^{y,x) is Lipschitz continuous in x with the constant C*{a) for all n = 1,2, .. . 

D 



Corollary For any n — 1,2, . . . the function s„{x; a, Sq) defined in ^ll^ ) is Lipschitzian with the constant C*{a); it 
satisfies 

max Sn{x; a, sq) — min Sn{x; a, sq) < C*{a) (19) 



and for all m E T,, m > n, 



Smix; a, Sq) = min {sm-n{y; a, sq) + L'^^iy, x)). (20) 

j/GR 



Proof. From ( |l7| ) it follows that s„(a;; a, so) is Lipschitzian with the constant C*{a) as a pointwise minimum of a 
family of C*(a)-Lipschitzian functions. Taking into account periodicity of s„(a;; a, sq), we obtain (|lS|). Equation (EO) 
follows from (Hq) for ni — m — n, n2 — n. D 

Suppose S°'(t, x) is a viscosity solution to equation (|l|) of the form (||); then for t > it is a solution of Cauchy 
problem for equation (||) with the initial data 50(0;) = S°'{Q,x). Hence, 

S^it, x) = min (5''(0, y) + L{Q, y; t, x)), t> 0. 
yes. 

Denote s°(x) = S°'{0,x) - ax = s°(0,a;). It follows from (H) that S"'{l,x) - ax + H{a) = s^ix). Thus, 

min {s''{y) + a{y ~ x) + L(0, y; 1, xj) + H{a) = s''(x). 

yeR 



Using the above notation, we rewrite this as 

s^{x) = min (s'^(y) + Lfiv, x)) + H{a). (21) 

2/GR 

On the other hand, let s°-{x) satisfy the functional equation (pT|); then the solution (0) of the Cauchy problem 
for equation (|l|) with the initial data 6*0(2;) = ax + s°-{x) has the form (||). Thus to prove theorem I it is sufficient 
to show that for any a G M there exist a number H{a) and a continuous periodic function s°'{x) such that ( |2l|) is 
satisfied. 

4 Proof of theorem I 

Let a e M. We denote 

HJa)^ max ( L't(y,x)\ ^ max ( L{Q,y;n,x) + a- — -\ . (22) 

{y,x)<^M? \ n J (a,a:)GR2 V '^ Ti J 

Proposition 8 For any a G R there exists H{a) G M such that 

\H„{a)^Hia)\<^-^, (23) 

n 

where C*{a) is the Lipschitz constant of the function L'^{y^x). The function a ^-> H{a) is convex and satisfies 
inequalities 

m < H{a) - Ho{a) < M, (24) 

where m and M were defined in lemma y. 

Proof. Let 50(2;) = 0, s„(a;) = s„(x; a, sq) (see (|l7|)). It follows from (|2(]| ) that for any integer n, no, < no < n, 

s„(x) = min(s„_„o(y) +L°^(y,a;)). (25) 



We see that miuajgR Sn{x) = minjj, 2,)£R2 L'^{y, x) = — n_ff„(a) for any n = 1, 2, ... It follows from the corollary to 
proposition R that —nHn{a) < Sn{x) < —nHn{a) + C*{a). Combining these inequalities with (25) and (p2|), we 
obtain 

-nHn{a) < Sn{x) < -(n - no)-ff„-„o(a) + C*{a) - no-ff„o(a), 

-(n - no)iJ„-„o(a) - naHn„ia) < s„(x) < -nHn{a) + C*{a). 

Hence, 

\nHnia) - noHnoia) - (n - no)-ff„-„o(a)| < C*{a). 

Since n > no, there exist integer p > 1 and < q < n such that n — pno + q. Then by induction over p it is easily 
checked that \nHn{a) — pnQHng{a) — qHq{a)\ < pC*{a), that is 



q . 



Hnia) - ff„„(a) + -(i/„o(a) - Hgia)) < ^C*(a) < —C*{a). 
n 1 ^ ^ 



-C*{a)< — 
n no 



Let £ > be arbitrarily small, no be so large that the right-hand side of this inequality is less than e, and A'' 
be such that (l/A^) maxi<q<„(, \q{HnQ{a) — Hq{a)\ < e; then |i/„^(a) — Hn^ia)] < 4e for all ni, n2 > N. Thus 
{Hn{a)}, n = 1, 2, . . ., is a Cauchy sequence. Denote its limit by H{a); then we get ( |2^ ) from the above inequality 
in the limit n — > 00. 

Suppose ai, a2 G M, < a, /? < 1, a + /3 = 1. Using definition of Hn{a) (|2^), we obtain 

Hn{aai + j3a2) = -^ min(j,^^)gR2 (L(0, y; n, a;) + [aai + /?a2)(y - x)) = 

= -imin(j^_j,)gR2 [a(L(0,y;n, a;) +ai(y-a;)) + /3(L(0, y; n, a;) + a(y - a;))) < 
<aiJ„(ai)+/3i?„(a2). 

In the limit n — > 00 this implies that the function H{a) is convex. 



Finally, lemma ^ implies that —M < (l/n)i(0, y; n, x) — Lq{{x — y)/n) < ~m. Hence, 

x — y f X — y\ x — y 1 x — y fx — y 

m + a Lq 1 < a -^(0, y, n, x)<M + a Lq 



n \ n J n n n \ n 

p2 



Taking max over {y,x) G M^, using (C2), and denoting (a; — y)/n by v, we obtain 

m + max (af — LqIv)) < Hnia) < M + max (at; — Ln(v\). 

But by a well-known formula for the Legendre transform max^gR {av — Lo(t')) = Ho{a). Thus we obtain ( |24| ) in 
the limit n — > oo. D 

Suppose a G K. and sq{x) is a continuous and periodic function. We claim that there exists 

liminf {sn{x; a, sq) + nH{a)) = s°'{x) (26) 

n — >cxD 

and s°'{x) satisfies (pl|), i.e., the solution of the Cauchy problem for equation (pi) with the initial data Sq{x) = 
ax + s°(x) has the form (0). Combining this with proposition 0, we get the statement of theorem I. 
Using definitions of s„(x; a, sq) f^nd Hn{a), we get 

min so{y) - nHn(a) < s„(x; a, sq) < max so{y) - nH„{a). 

Adding nH(a) and using (Eq), we obtain 

min so(y) ~ C*{a) < s„(a;; a, sq) + nH{a) < max so(?/) + C*(a). (27) 

Let 

s„(a;) = inf (sm(a;; a, sq) + r7iiJ(a)), n=l,2, 

For any x G K the sequence {s„(a;)} is nondecreasing; it follows from ( P7| ) that it is bounded. Further, the corollary 
to proposition R implies that all functions Sn{x) are Lipschitzian with the constant C*{a); hence, this sequence is 
equicontinuous. It follows that there exists 

lim Sn{x) = liminf (sn(x; a, Sq) + nH{a)) — s°'{x) 

n — ^OO 77 — *oo 

and s°'{x) is periodic and continuous. 

Let us check that s°'{x) satisfies (pl|). We have 

mm{sn{y) + L1{y,x)) + H{a) = 

J/6R 

= min( iiif {min (soiz) + L'^{z,y) + L1{y,x) + (m + l)H{a)))). 

y€M. m>n z^K 

But it follows from the definition of -ff„(a) and proposition |8| that L'^{z, y) + mH{a) > —C*{a) for all ?7i = 1,2,... 
Therefore we can take minimum over ?/ G M before infimum over m > n and obtain 

min(s„(y) + L'l{y,x)) + H{a) = s„+i(x). 

ySR 

After passage to the limit n ^ oo this yields that s°'{x) satisfies (pi|). 

5 A many- valued map associated with s"'{x) 

Suppose a G M, s°-{x) is a continuous periodic function satisfying (pl|). Denote La{y, x) — L{0, y; 1, x) + aijj — x) + 
H{a). Let Y°-{x) be the many- valued map of R to R defined by 

r'^(x) =argmin(s"(y)-t-ia(y,x)), (28) 

yeR 

where 

argmin/(z) = {zeZ\ f{t) > f{z) for all teZ}. 



It is readily seen that if x, y £ R, then y G Y'^{x) iff 

s%y) + L,(y, x) = s"(x) = min (s'^(z) + L,(z, x)). (29) 

For any X C K, y C R, by X + y we denote the set {z £ R| z == a; + y, x G X, y e F}. If F = {y}, by X + y 
we mean X + {y}. 

Lemma 9 For all x eR 

y"(a; + l) = r"(a;) + l. (30) 

// there exists Xq G M. such that x G V^^xq), then the set V^lx) contains only one point. If Xi, X2, yi, 2/2 G R; 
xi < X2, 2/1 G ^(3^1), and 3/2 G y°(a:2), <ften yi < 2/2- 

Proof. Equation ( po| ) follows from periodicity of s"-{x) and lemma g. 
Suppose xi < X2 and yi G y°(xi), i = 1,2. By (p9|), it follows that 

s"(2/i) + L(0, 2/1; 1, xi) + 02/1 < s"(2/2) + L{0, 2/2; 1, a^i) + 02/2, 
s"(2/2) + i(0, 2/2; 1, 2:2) + 02/2 < s'^ivi) + i(0, 2/1; 1, 2:2) + ayi, 

that is 

L{0,yi;l,xi) + L(0, 2/2; 1,2:2) < L(0, 2/2; l,a;i) + i(0, 2/1; 1, a;2)- 

Thus it follows from the corollary to proposition @ that j/i < 2/2 ■ 

Let us check that 2/1 < 2/2- Assume the converse; let y — yi =2/2- Take any 2/0 G y^(2/). By (EOh, it follows that 

s'^(x,) = s''(2/o) + i(0, 2/0; 1, y) + i(l, 2/; 2, x,) + a(2/o - x{) + 2i/(a), 2 = 1,2. 

On the other hand, using (|2l|), we get 

s°(a;,) = min min (s^'it) + L(0, i; 1, z) + L(l, z; 2, xA + a(i - a;^) + 2H{a)) < 

zeR tGR 

< min (s^iyo) + L{0, 2/0; 1, z) + L{1, z; 2, x^) + 0(2/0 - x,) + 2H{a)), 
i = 1,2. 

Hence it follows from proposition |6| that xi = X2', this contradiction proves that 2/1 < 2/2- 

Finally, suppose x G Y°'{xq) for some xq G R and 2/1 j 2/2 G y°(x). By a similar argument, we see that 2/1 =2/2- 
Thus y (x) consists of a single point. D 

Proposition 10 Suppose Mq = R, M„ = F" (M„_i), n = 1,2,.. .; then Mq D Mi D M2 D . . . and there exists a 
nonempty closed set M" such that (i) M" = H^o -^"' (^^) f^''' ^''^V open f/ C R such that Af ° C t/ + Z i/iere esiste 
N > with the following property: if the sequence {y-n} is such that 2/n+i & Y'^{yn), n — 0,1, . . ., then yn E U + 2, 
for all n > N; (Hi) the restriction yJMa ofV^ to M'^ is a single-valued bijective continuous map of the set M"' 
into itself with continuous inverse. 

Proof. Evidently, all Af„ ^ and Mo = R contains A/i. Suppose Af„ C M„_i for some n > 1, a; G -M„; then 
Y'^ix) C Y'^iMn) C F'^(M„_i) = Af„. Hence, Af„+i = ^^(Af^) C Af„. 

Let us show that all Af„, ?i = 1, 2, . . ., are closed. Note that Mq = R is closed. Suppose Mn is closed and the 
sequence 2/fe G Mn+i, k ~ 1,2, . . ., has a limit y G R. It follows from lemma M that for any k there exists a unique 
xj. = (y)~^(2/fe) G Af„ and all xj. are contained in a bounded interval. Thus there exists a subsequence {xj,, } that 
converges to a limit x G Af„. Using (p9|), we get 

s° (2/fc J + ia (2/fc, , a;fc, ) = s° (xfc, ) . 

Since the finctions s°'{x) and La{y,x) are continuous, we obtain 

s''{y) + Laiy,x)^s-ix). 



Now it follows from (|9|) that y G y°(S). Hence 2/ e F"(Afn) = Mn+i, that is A/„+i is closed. 

Consider the topology T on R such that V G T iS V = U + Z, where U is open in the usual sense. Note that 
R is compact in this topology. It follows from ( pO|) that complements C/„ of sets Mn are open in the topology T. 
We see that C/„ c Un+i- 



Clearly, the set M" = H^o -^" ^^ closed. Let us check that it is nonempty. Assume the converse; hence sets 
Un, n = 1,2, .. . cover all R. Since R is compact in the topology T, we see that there exists N > such that 
K = Un=o ^n = ^N- Thus Mn — 0] this contradiction proves that M" is nonempty. 

Now let y G T be such that Af° C F. Arguing as above, we obtain that there exists A^ > such that 
M = y U Un- On the other hand, for any sequence {yn} such that yn+i G y^iVn), n = 0, 1, . . ., it follows that 
yn G Mn- Thus for all n > A we obtain yn & V. 

Denote by y|M„: Mn -^ Mn+i the restriction of F° to M„, n = 1, 2, ... It follows from lemma ^ that 1^"|m„ 
is single- valued, strictly increasing as a function R — > M, and bijective. We claim that it is a homeomorphism. 
Indeed, let sequences {xk} C Af„ and {yk} C Af„+i be such that Y°-{xk) — yk for all k. If y^ converge to y, then it 
follows from strict monotonicity of y Ia/,, that x^ converge to a unique x; hence the map y^|M„ has a continuous 
inverse. Further, if x^ converge to x, then the set {yu} is bounded. Let j/i, y2, j/i 7^ 2/2 j be two limit points of 
{yfc}; then we see from ( p9| ) that {2/1,^2} C y(x), since s°(a::) and La{y,x) are continuous. But the map i^°|A/„ 
is single- valued; this contradiction proves that it is continuous. 

By the above M" is a closed subset of M„ for all n = 1,2 . . .; in addition, r°(M°) = M". It follows that the 
restriction of Y°'\m„ to A/° is an (auto)homeomorphism of the set A'/°. D 

We say that A/° is the invariant set of the many- valued map Y'^''{x). 

6 The connection with Aubry— Mather theory 

The following remarks concern the results of Aubry-Mather theory that are needed for the proof of theorem II. 

Let a function i(j/, x) be everywhere finite and continuous on R^, diagonally periodic in the sense of lemma g, 
tend to plus infinity as \x — y\ ~^ 00, and for all xi, X2^ yi, 2/2 G R satisfy the following conditions: (i) L{yi,xi) + 
L{y2,X2) < L{y2,xi) -\- L{yi,X2) whenever xi < X2, yi < 2/2; (ii) if zq G R is such that for all z G R L{yi,z) + 
L{z, Xi) > L{y,, zo) + L{zo, x^), i = 1,2, then either xi = X2 and yi = j/2 or (a;i - X2)iyi - 2/2) < 0. 

Suppose a sequence {xn}, n £ Z, has the following property: for all Ai, A'2 G Z, Ai < A'2, and any set {yj}, 
j = Ni,Ni + l,...,N2, such that yNi = xn^ , yN2 = XN2 , 

N2-1 N2-1 

j=Ni ]=Ni 

then this sequence is called an L-minimal configuration. 

Proposition 11 Suppose the function L{y,x) satisfies the above conditions and {a;„}, n £ Z, is an L-minimal 
configuration; then there exists 

lim ^!L^^ = cj({a;„}) G M. (31) 

n-^±oo n 

If LU = uj{{xn}) is irrational, then there exists a function (f)i^(t): R ^ R with the following properties: (i) it 
is continuous on the right and 4>uj{ti) < 4'ui{t2) iff ti < ^2; (H) 4>u{t + 1) = 4>ui{t) + 1 for all t G R; (Hi) if 
Xq = (jj^iito ± 0) then the sequence {xn} defined by Xn = 4>u{ta + noj ± 0) is L-minimal; (iv) for any neighborhood 
V ^T of the closure of the image 0a;(R) o,nd any L-minimal sequence {xn}, Xn ^V as soon as \n\ is large enough. 



For the proof see, e.g., |10, sections 9, 11, and 12]. The number Lo{{xk\) is called a rotation number of the L-minimal 
configuration {xk\. 

Notice that La{y,x) defined in the previous section satisfies the conditions for L{y,x). 



Proposition 12 Suppose a G R, s"'{x) is a continuous periodic function satisfying ^ly, y (a;) is the corresponding 
many-valued map, M°' is its invariant set, andx G Af^. Then the sequence Xk = (y)^'^(x), k £ 7^, is an L-minimal 
configuration. If yk = {Y°')^'^{y), k E Z, for some y G M"-, then uj{{xk}) = uj{{yk})- 



Proof. From (E9h it follows that s°-{xn+i) = s°(a;„) -\- La{xn,Xn+i). Hence, 



N2-1 

s'^ixN^) - s'^{xnJ ^ Y La{xk,Xk+l). (32) 

k=Ni 
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On the other hand, 

/ N2-1 



s^ixN^) = min s°(?/ArJ + Y^ La{yk,yk+i) , 

where yN2 = xn^. Thus for any set {yj}, j — Ni,Ni + I, . . . , N2, such that i/n-^ — xn-^, yj^^ = xatj, we have 



7V2-1 
s" {XN, - s'' (xjvi ) < ^ L, (yfe , yfe+i ) . (33) 

fc=JVi 

Combining (|3^) with (|33[), we see that {a;„} is L- minimal. 

Now let j/fe = (y)^'^(?;) for some y G Af°. Take p £ Z such that a:<y + p<a; + l. By lemma |[ it follows 
that (r")-'=(a;) < (F°)-'=(y + p) < (r°)-'=(a; + 1) for aU A: e Z. Using (|l|), we obtain w({a;fe}) ^Lu{{yk}). D 

7 Proof of theorem II 

Let a £ M, s°-{x) be a continuous periodic function satisfying (|2l|), and M° be the invariant set of the corresponding 
map Y"'{x). A subset M C M° is called a minimal set of the (single- valued) map y |m» if M is closed, Y°-{M) = M, 
and M contains no other nonempty subset with the same properties. Let x € M"; the sequence {{Y"-)''{x)}, 
k = 1,2,..., is called the orbit of the point x. It can be proved that a set M C M" is minimal if and only if the 
orbit of any point a:: G M is dense in M in topology T defined in the proof of proposition nu. 

Lemma 13 Suppose s'^{x) and S2{x) are continuous periodic functions satisfying n2i) and Y"'{x) is the many- 
valued map corresponding to Si(x); then for all a;, y e R such that y G Y°'{x) 

4(.x)-s^2{x)>sUy)-4iy)- (34) 



Proof. It follows from (g9|) that s°(x) = s^iy) + La{y,x). Using (|17D, we obtain 

sUx) ~ s%(x) = 4(y) + La{y, x) - s^{x) = 

= 4(y) + La{y,x) - 4 (a;) + s^y) - s^y) > 
>s?(y)-s^(2/). 

This completes the proof. D 

Let Si{x) and S2{x) be functions satisfying the assumptions of lemma [li^, Yf_(x) and Y2{x) be the corresponding 
many-valued maps, and Aff and AI2 be their invariant sets. By proposition |l2|, it follows that the corresponding 
rotation numbers wi and UJ2 are determined uniquely. The set Aff is compact in topology T; using (pO|), we see 
that F]° is a homeomorphism of Aff in this topology. By the well-known theorem of Birkhoff Q , it follows that 
Mf contains at least one minimal set of the map Yj°; denote it by Mi. 

Clearly, s°(x) and S2{x) are continuous in topology T. Let xq G Mi be a point where sf{x) — S2{x) attains its 
minimal value in A/i and {xk}, fc = 1, 2, . . ., be its orbit. By the above lemma, 

Sii^o) - S2{xo) < Si(xfc) - s^{xk) < s'lixo) - 4(xo). 

Since the closure of {xk} is the set Afi, we see that on Afi Si{x) — 52(2;) is constant. Thus it follows from ( p9| ) that 
on the set Afi the map Yi{x) coincides with Y2{x). In particular, uji = L02 = uj or equivalently, to depends only 
on a. We see also that if Ai^ is a minimal set of the map corresponding to some s°'{x) satisfying ([2l|), then it is a 
minimal set of any other continuous periodic function satisfying (UW with the same a. 

Now suppose lli — aj(a) is irrational. Let us show that for any continuous periodic function s°'{x) satisfying ( pl| ) 
the invariant set A/° is minimal and hence uniquely determined. Indeed, consider some s°'{x); let x G Af* and 
{ccfc}, k = 1,2,..., be its orbit. It follows from propositions 11^ and lll| that there exists io G M such that 
Xk — 4>uj{tQ + few ± 0); in particular, this means that Af^ is the closure of the set (/)(^(M). Since w is irrational, for 
any t G M, e > there exist p+, p_, (7+, g_ G Z, g+ > 0, q- > 0, such that p- —q-uj G [t — e,t], p+ —q+uj G [t,i-t-£]. 
Using strict monotonicity of (puj, we see that the orbit of x is dense in M°- in topology T. This proves that Af ° is 
minimal. 
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Finally let us prove that if a; = (jj{a) is irrational, then Si{x) — S2{x) is constant for all a; G K. Without loss of 
generality it can be assumed that s1{x) — 83 (x) = on M". Let xq G M be a point where sj(x) — 52(2;) attains its 
minimum in R and {xk}-, fc = 1, 2, . . ., be its orbit. Arguing as above, we see that s1{xk) — S2{xk) — sJ(a;o) — 52(^0) 
for all fc > 1. On the other hand, it follows from proposition |l^ that for any neighborhood V & T oi the set M" 
there exists N > such that Xk € V for all k > N. Using continuity of the functions s"(x) and S2{x), we see that 
Si{xo) — 52(^0) = 0. By definition of xa, it follows that Si{x) > S2{x) for all a; e M. Likewise, s°(x) < 52(^)1 thus 
sfix) = si(x). 

We have proved that if w(a) is irrational, then the functional equation ( pl| ) has a unique solution s°'{x) in the 
class of continuous periodic functions up to an additive constant. Thus the solution (ra) of the form (0) to the 
Cauchy problem for equation (m) with the initial data So{x) — ax + s'^{x) is determined uniquely up to an additive 
constant. This completes the proof of theorem II. 
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